Combination and Calibration Methods for Probabilistic Forecasts of Binary Events
نویسندگان
چکیده
Probabilistic forecasts of atmospheric variables are often given as relative frequencies obtained from ensembles of deterministic forecasts. The detrimental effects of imperfect models and initial conditions on the quality of such forecasts can be mitigated by calibration. This paper shows that Bayesian methods currently used to incorporate prior information can be written as special cases of a Beta-Binomial model and correspond to a linear calibration of the relative frequencies. These methods are compared with a nonlinear calibration technique, logistic regression, using both artificial datasets and real precipitation forecasts. Calibration is found to be advantageous in all cases, and logistic regression is preferable to linear methods.
منابع مشابه
Probabilistic forecasts, calibration and sharpness
Probabilistic forecasts of a continuous variable take the form of predictive densities or predictive cumulative distribution functions. We propose a diagnostic approach to the evaluation of predictive performance that is based on the paradigm of maximizing the sharpness of the predictive distributions subject to calibration. Calibration refers to the statistical consistency between the distribu...
متن کاملConsensus Probabilistic Forecasting
To make optimal decisions, end-users of decision support systems require information accurately describing the uncertainty of the underlying weather forecasts. Air temperature, dew point temperature, and wind speed are critical surface weather variables in many economic sectors. The generation of sharp and calibrated probabilistic forecasts and their effective presentation to decision makers ar...
متن کاملEvaluating probability forecasts for GDP declines using alternative methodologies
Evaluation methodologies for rare events from meteorology, psychology and medical diagnosis are used to examine the value of probability forecasts of real GDP declines during the current (Q0) and each of the next four quarters (Q1-Q4) using data from the Survey of Professional Forecasters. We study the quality of these probability forecasts in terms of calibration, resolution, odds ratio, the r...
متن کاملUse and communication of probabilistic forecasts
Probabilistic forecasts are becoming more and more available. How should they be used and communicated? What are the obstacles to their use in practice? I review experience with five problems where probabilistic forecasting played an important role. This leads me to identify five types of potential users: Low Stakes Users, who don't need probabilistic forecasts; General Assessors, who need an o...
متن کاملMixture EMOS model for calibrating ensemble forecasts of wind speed
Ensemble model output statistics (EMOS) is a statistical tool for post-processing forecast ensembles of weather variables obtained from multiple runs of numerical weather prediction models in order to produce calibrated predictive probability density functions. The EMOS predictive probability density function is given by a parametric distribution with parameters depending on the ensemble foreca...
متن کامل